Method and device for collecting sounds corresponding to surveillance images

ABSTRACT

Aspects of the disclosure provide a method for collecting sounds associated with surveillance images. The method includes identifying a sound-making surveilled object in the surveillance images, the surveillance images being captured by a camera of a monitoring device; determining whether a sound acquiring device meets a preset condition corresponding to that a signal strength of the sounds collected by the sound acquiring device from the identified surveilled object is greater than a signal strength of the sounds collected by the monitoring device from the identified surveilled object; and, when determining that the sound acquiring device meets the preset condition, controlling the sound acquiring device to collect the sounds from the identified surveilled object.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims priority to Chinese PatentApplication No. 201510462792.9, filed Jul. 31, 2015, the entire contentsof which are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure generally relates to the field of computertechnologies, and more particularly, to a method and device forcollecting sounds associated with surveillance images.

BACKGROUND

Cameras can be used to monitor the occurrences of various events, andthe monitoring function of cameras is widely applied to, for example,traffic surveillance, supermarket surveillance, or communitysurveillance, and the like.

During surveillance using cameras in a monitoring device, if asound-making surveilled object in the surveillance images (i.e., animage of the sound-making surveilled object is visible in thesurveillance images) is relatively far from the monitoring device, themonitoring device cannot clearly collect the sound from the surveilledobject, and thus the surveillance information is not complete.

SUMMARY

Aspects of the disclosure provide a method for collecting soundsassociated with surveillance images. The method includes identifying asound-making surveilled object in the surveillance images, thesurveillance images being captured by a camera of a monitoring device;determining whether a sound acquiring device meets a preset conditioncorresponding to that a signal strength of the sounds collected by thesound acquiring device from the identified surveilled object is greaterthan a signal strength of the sounds collected by the monitoring devicefrom the identified surveilled object; and, when determining that thesound acquiring device meets the preset condition, controlling the soundacquiring device to collect the sounds from the identified surveilledobject.

In an embodiment, the method further includes, when determining that thesound acquiring device does not meet the preset condition, collectingthe sounds from the identified surveilled object by the monitoringdevice.

In an embodiment, identifying the sound-making surveilled object in thesurveillance images includes detecting a movement of the surveilledobject that corresponds to a predetermined sound-making movement, thepredetermined sound-making movement including the surveilled objectentering a surveillance area or the surveilled object having movinglips; or determining whether the surveilled object is a predeterminedsound-making object, the predetermined sound-making object including adoor, a window, or a home appliance; or detecting, by a detection deviceassociated with the surveilled object, one or more parameters, andidentifying the sound-making surveilled object based on the one or moreparameters from the detection device, the one or more parametersincluding an on/off state, a temperature, a change of a heat source, ora physiological feature of the surveilled object.

In an embodiment, determining whether the sound acquiring device meetsthe preset condition includes determining whether the signal strength ofthe sounds from the identified surveilled object collected by themonitoring device is smaller than a preset sound threshold; and, whendetermining that the signal strength of the sounds from the identifiedsurveilled object collected by the monitoring device is smaller than thepreset sound threshold, determining that the sound acquiring devicemeets the preset condition.

In an embodiment, determining whether the sound acquiring device meetsthe preset condition includes: identifying a sound acquiring deviceclosest to the sound-making surveilled object among all sound acquiringdevices associated with the monitoring device, and determining theidentified sound acquiring device as the sound acquiring device meetingthe preset condition; or controlling all sound acquiring devicesassociated with the monitoring device to collect the sounds from thesound-making surveilled object, and determining a sound acquiring devicethat detects a strongest signal strength of the sounds from thesound-making surveilled object as the sound acquiring device meeting thepreset condition; or determining at least one mobile device associatedwith the monitoring device as the sound acquiring device meeting thepreset condition.

In an embodiment, identifying the sound acquiring device closest to thesound-making surveilled object among all the sound acquiring devicesassociated with the monitoring device includes: identifying the soundacquiring device closest to the sound-making surveilled object among allthe sound acquiring devices associated with the monitoring device byperforming an indoor positioning process; or determining a location ofthe sound-making surveilled object by performing an image recognitionprocess, and determining a sound acquiring device for monitoring thesounds from the sound-making surveilled object according to respectivesurveillance area ranges corresponding to the sound acquiring devices.

Aspects of the disclosure provide a device for collecting soundsassociated with surveillance images. The device includes a processor anda memory for storing instructions executable by the processor. Theprocessor is configured to identify a sound-making surveilled object inthe surveillance images, the surveillance images being captured by acamera of a monitoring device, to determine whether a sound acquiringdevice meets a preset condition corresponding to that a signal strengthof the sounds collected by the sound acquiring device from thesurveilled object is greater than a signal strength of the soundscollected by the monitoring device from the surveilled object, and to,when determining that the sound acquiring device meets the presetcondition, control the sound acquiring device to collect the sounds fromthe identified surveilled object.

In an embodiment, the processor is configured to, when determining thatthe sound acquiring device does not meet the preset condition, collectthe sounds from the identified surveilled object by the monitoringdevice.

Aspects of the disclosure provide a non-transitory computer-readablestorage medium having stored therein instructions that, when executed bya processor of a monitoring device, causes the monitoring device toperform a method for collecting sounds associated with surveillanceimages. The method includes: identifying a sound-making surveilledobject in the surveillance images, the surveillance images beingcaptured by a camera of a monitoring device; determining whether a soundacquiring device meets a preset condition corresponding to that a signalstrength of the sounds collected by the sound acquiring device from thesurveilled object is greater than a signal strength of the soundscollected by the monitoring device from the surveilled object; and, whendetermining that the sound acquiring device meets the preset condition,controlling the sound acquiring device to collect the sounds from theidentified surveilled object.

In an embodiment, the instructions that, when executed by the processorof the monitoring device, causes the monitoring device to perform amethod further including, when determining that the sound acquiringdevice does not meet the preset condition, collecting the sounds fromthe identified surveilled object by the monitoring device.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate embodiments consistent with thepresent disclosure and, together with the description, serve to explainthe principles of the present disclosure.

FIG. 1 is a flowchart showing a method for collecting sounds associatedwith surveillance images according to an exemplary embodiment.

FIG. 2A is a flowchart showing a method for determining whether a soundacquiring device meets a preset condition according to an exemplaryembodiment.

FIG. 2B is a flowchart showing a method for identifying a sound-makingsurveilled object in the surveillance images according to an exemplaryembodiment.

FIG. 2C is a schematic diagram showing that a surveilled object entersinto a surveillance area according to an exemplary embodiment.

FIG. 2D is a schematic diagram showing that there is a surveilled objecthaving moving lips in surveillance images according to an exemplaryembodiment.

FIG. 2E is a schematic diagram showing an object in the surveillanceimages being a predetermined sound-making object according to anexemplary embodiment.

FIG. 2F is a schematic diagram showing detection of whether there is asound-making surveilled object in the surveillance images according toone or more parameters reported by a detection device according to anexemplary embodiment.

FIG. 2G is a flowchart showing a method for determining a soundacquiring device meeting a preset condition according to an exemplaryembodiment.

FIG. 2H is a schematic diagram showing that a sound acquiring devicethat detects the strongest signal strength of the sound from theidentified surveilled object is determined as the sound acquiring devicemeeting the preset condition according to an exemplary embodiment.

FIG. 2I is a flowchart showing a method for identifying a soundacquiring device closest to the sound-making surveilled object among allsound acquiring devices associated with the monitoring device accordingto an exemplary embodiment.

FIG. 2J is a schematic diagram showing that the monitoring devicedetermines a sound acquiring device for monitoring the sounds from thesound-making surveilled object according to an exemplary embodiment.

FIG. 2K is a flowchart showing a method for controlling a soundacquiring device to collect sounds from the surveilled object accordingto an exemplary embodiment.

FIG. 2L is a schematic diagram showing that a monitoring device controlsa mobile device to move to a location adjacent to a sound-makingsurveilled object in surveillance images according to an exemplaryembodiment.

FIG. 3 is a block diagram showing a device for collecting soundsassociated with surveillance images according to an exemplaryembodiment.

FIG. 4 is a block diagram showing a device for collecting soundsassociated with surveillance images according to another exemplaryembodiment.

FIG. 5 is a block diagram showing a device for collecting soundsassociated with surveillance images according to an exemplaryembodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings. The followingdescription refers to the accompanying drawings in which the samenumbers in different drawings represent the same or similar elementsunless otherwise represented. The implementations set forth in thefollowing description of exemplary embodiments do not represent allimplementations consistent with the present disclosure. Instead, theyare merely examples of devices and methods consistent with aspectsrelated to the present disclosure as recited in the appended claims.

FIG. 1 is a flowchart showing a method for collecting sounds associatedwith surveillance images according to an exemplary embodiment. As shownin FIG. 1, the method for collecting sounds associated with surveillanceimages includes the following steps.

In step 101, when surveillance images are captured by a camera of amonitoring device, whether there is a sound-making surveilled object inthe surveillance images is detected.

Generally, a monitoring device can collect not only surveillance imagesbut also sounds made by a surveilled object in the surveillance images.

In step 102, if there is a sound-making surveilled object in thesurveillance images identified in step 101, whether a sound acquiringdevice meets a preset condition is determined. The preset conditioncorresponds to that a signal strength of sound from the identifiedsurveilled object detected by the sound acquiring device is greater thana signal strength of the sound from the identified surveilled objectdetected by the monitoring device.

At present, even though a monitoring device can clearly collectsurveillance images, the monitoring device may not effectively collectthe sounds from a surveilled object in the surveillance images. Forexample, if the surveilled object in the surveillance images makes veryweak sounds or the surveilled object in the surveillance images isrelatively far from the monitoring device, the sounds from thesurveilled object cannot be clearly collected by the monitoring device,and may even be automatically filtered by the monitoring device. Thus,in some examples, an additional sound acquiring device meeting a presetcondition is required to collect the sounds from the surveilled object.

The preset condition here may be various conditions that correspond tothat a signal strength of the sounds collected by the sound acquiringdevice from the surveilled object is greater than a signal strength ofthe sounds collected by the monitoring device from the surveilledobject. When the preset condition is met, the sound acquiring devicemeeting the preset condition is turned on to collect the sounds from thesurveilled object.

The sound acquiring device here may be devices having sound collectingmembers such as a mobile phone, an audio apparatus, or a Bluetoothheadset.

In step 103, when determining that the sound acquiring device meets thepreset condition, the sound acquiring device is controlled to collectthe sounds from the surveilled object. Thus, the audio signal isrecorded based on the sound from the identified surveilled objectcollected by the sound acquiring device.

When the monitoring device detects that the surveilled object in thesurveillance images makes sounds but the sounds from the surveilledobject are too weak or the surveilled object is too far from themonitoring device, the monitoring device cannot clearly collect thesounds from the surveilled object. At this time, the monitoring devicemay control the sound acquiring device meeting the preset condition tocollect the sounds from the surveilled object.

In view of the above, in the method for collecting sounds associatedwith surveillance images provided by embodiments of the presentdisclosure, a sound-making surveilled object in the surveillance imagesis identified, and a sound acquiring device which collects sounds of agreater signal strength from the surveilled object than the signalstrength of the sounds collected by the monitoring device from thesurveilled object is controlled to collect the sounds from thesurveilled object. Thus, the present disclosure can solve the problemthat a monitoring device cannot clearly collect sounds from a surveilledobject which is relatively far from the monitoring device. Themonitoring device controls the sound acquiring device to collect thesounds from the surveilled object, and thus the surveillance informationbecomes more complete.

FIG. 2A is a flowchart showing a method for determining whether a soundacquiring device meets a preset condition according to an exemplaryembodiment. In an example implementation, the step 102 in FIG. 1 mayinclude steps 102 a to 102 b depicted in FIG. 2A. As shown in FIG. 2A,the detection of whether there is a sound-making surveilled object insurveillance images by the monitoring device may include the followingsteps.

In step 102 a, whether the signal strength of the sounds associated withthe surveillance images collected by the monitoring device is less thana preset sound threshold is determined.

When the sounds from the surveilled object in the surveillance imagesare too weak or the surveilled object in the surveillance images is toofar from the monitoring device, the sounds made by the surveilled objectcannot be clearly collected by the monitoring device. Thus, the presetsound threshold here refers to a threshold determining whether themonitoring device can clearly collect the sounds from the identifiedsound-making surveilled object. When the signal strength of the soundsfrom the identified sound-making surveilled object collected by themonitoring device is less than the preset sound threshold, themonitoring device is considered as incapable of effectively collectingthe sounds associated with the surveillance images temporarily.

In step 102 b, if the signal strength of the sounds associated with thesurveillance images collected by the monitoring device is less than thepreset sound threshold, a sound acquiring device other than themonitoring device is determined as meeting the preset condition.

When the signal strength of the sounds from the identified sound-makingsurveilled object collected by the monitoring device is less than thepreset sound threshold, the monitoring device is considered as incapableof effectively collecting the sounds associated with the surveillanceimages temporarily. Thus, the sound acquiring device meeting the presetcondition will be used to collect the sounds associated with thesurveillance images instead of the monitoring device.

In view of the above, in the method for collecting sounds associatedwith surveillance images provided by embodiments of the presentdisclosure, a sound-making surveilled object in the surveillance imagesis identified, and a sound acquiring device which collects sounds of agreater signal strength from the surveilled object than the signalstrength of the sounds collected by the monitoring device from thesurveilled object is controlled to collect the sounds from thesurveilled object. Thus, the present disclosure can solve the problemthat a monitoring device cannot clearly collect sounds from a surveilledobject which is relatively far from the monitoring device. Themonitoring device controls the sound acquiring device to collect thesounds from the surveilled object, and thus the surveillance informationbecomes more complete.

In addition, when the monitoring device cannot clearly collect thesounds made by the surveilled object, the monitoring device may send acollection instruction to a sound acquiring device meeting a presetcondition to instruct the sound acquiring device to collect the soundsfrom the surveilled object. The preset condition requires that the soundacquiring device is closest to the surveilled object, or that the soundacquiring device collects the strongest sound signal, or that the soundacquiring device is a mobile device associated with the monitoringdevice.

FIG. 2B is a flowchart showing a method for identifying a sound-makingsurveilled object in the surveillance images according to an exemplaryembodiment. Various example implementations of Step 101 are shown inFIG. 2B. As shown in FIG. 2B, step 101 may include one or more of thefollowing three implementations.

In a first implementation 101 a, whether there is an image changeelement corresponding to making sounds in the surveillance images isdetected. For example, a movement of the surveilled object thatcorresponds to a predetermined sound-making movement is detected. Thepredetermined sound-making movement includes the surveilled objectentering a surveillance area or the surveilled object having movinglips.

FIG. 2C is a schematic diagram showing surveilled objects entering intoa surveillance area corresponding to the surveillance images accordingto an exemplary embodiment. As shown in FIG. 2C, when a person 11, a cat12 and a dog 13 move into a surveillance area surveilled by a monitoringdevice 10, the monitoring device 10 can determine the person 11, the cat12, and the dog 13 as the surveilled objects. FIG. 2D is a schematicdiagram showing surveilled objects whose lips move in the surveillanceimages according to an exemplary embodiment. As shown in FIG. 2D, whenpersons 11 a and 11 b in the images surveilled by the monitoring device10 are talking, the monitoring device 10 can determine the persons 11 aand 11 b as the surveilled objects when detecting that the lips of thepersons 11 a and 11 b move.

In a second implementation 101 b, whether an object in the surveillanceimages is a predetermined sound-making object is determined. Thepredetermined sound-making object includes at least one of a door, awindow, or a home appliance.

Sometimes, when a door, a window, or a home appliance in surveillanceimages makes sounds (for example when a person is knocking at a door, aTV is turned on, or a fan runs), no significant changes will occur inthe surveillance images. Thus, in some examples, a predeterminedsound-making object is an object of a designated type which does notmove and the camera needs to determine whether to acquire sounds of theobject according to the recognized type of the object.

FIG. 2E is a schematic diagram showing an object of a designated typemaking sounds in the surveillance images according to an exemplaryembodiment. As shown in FIG. 2E, when a door 14 is knocked at, a TV 15is turned on, or a fan 16 runs in the surveillance images, even thoughthere is no significant changes in the whole surveillance images, themonitoring device 10 may still deem the door 14, the TV15, or the fan 16as the surveilled objects according to the knock, the sound made by TVprogram, or the sound made by blades of the fan.

In a third implementation 101 c, according to a designated index or oneor more parameters reported by a detection device, a sound-makingsurveilled object in the surveillance images is identified. Thedetection device is a device associated with the monitoring device fordetecting the designated index or the one or more parameters, and thedesignated index or the one or more parameters include an on/off state,a temperature, a change of a heat source, or a physiological feature ofthe surveilled object.

When the sounds made by the surveilled object in the surveillance imagesare too weak, the monitoring device may determine which surveilledobject in the surveillance images is a sound-making surveilled objectvia a detection device. The detection device here refers to a device fordetecting states of the surveilled objects and is installed around thesurveilled objects or on the surveilled objects.

For example, the detection device is installed on a switch of a homeappliance. When the home appliance is turned on, the detection devicesends the turning-on state data back to the monitoring device. Afterreceiving the data, the monitoring device determines that the homeappliance is a sound-making surveilled object, and sends a collectioninstruction to a sound acquiring device meeting a preset condition toinstruct the sound acquiring device meeting the preset condition tocollect the sounds from the home appliance. In another example, thedetection device may be installed nearby a window or a door. When thedoor or the window is open, and the detection device senses thetemperature changes of the ambient air, the detection device feeds thetemperature change data back to the monitoring device. After receivingthe data, the monitoring device determines that the window or the dooris a sound-making surveilled object, and sends a collection instructionto a sound acquiring device meeting a preset condition to instruct thesound acquiring device meeting the preset condition to collect thesounds from the door or the window.

FIG. 2F is a schematic diagram showing detection of whether there is asound-making surveilled object in the surveillance images according toone or more parameters reported by a detection device according to anexemplary embodiment. As shown in FIG. 2F, when a door 18 in thesurveillance images is open, a sensor 17 installed above the door 18senses the temperature changes of the ambient air, and feeds thetemperature change data back to a monitoring device 10. The monitoringdevice 10 receives the feedback data and sends a collection instructionto a sound acquiring device meeting a preset condition to instruct thesound acquiring device meeting the preset condition to collect thesounds from the door 18.

FIG. 2G is a flowchart showing a method for determining a soundacquiring device meeting a preset condition according to an exemplaryembodiment. Various example implementations of step 102 n are shown inFIG. 2G. As shown in FIG. 2G, the determination of the sound acquiringdevice meeting a preset condition (step 102 b) may include one or moreof the following three implementations.

In a first implementation 102 b 1, a sound acquiring device closest tothe sound-making surveilled object is identified among all soundacquiring devices associated with the monitoring device, and theidentified sound acquiring device is determined as the sound acquiringdevice meeting the preset condition.

When the preset condition corresponds to that the sound acquiring deviceis closest to the surveilled object, the monitoring device may identifya sound acquiring device closest to the sound-making surveilled objectaccording to the surveillance images, and determine the sound acquiringdevice as the sound acquiring device meeting the preset condition.

In a second implementation 102 b 2, all sound acquiring devicesassociated with the monitoring device are controlled to collect thesounds from the sound-making surveilled object, and a sound acquiringdevice which collects a strongest sound signal is determined as thesound acquiring device meeting the preset condition.

When the preset condition corresponds to that the sound acquiring devicecollects the strongest sound signal, the monitoring device may send acollection instruction to all sound acquiring devices to instruct all ofthe sound acquiring devices to collect the sounds from the surveilledobject in the surveillance images. After receiving the collectioninstruction, all the sound acquiring devices start to collect the soundsfrom the surveilled object and send signals representing the collectedsounds to the monitoring device. The monitoring device receives andchecks all the sounds collected by the sound acquiring devices,determines a sound acquiring device which collects the strongest soundsignal, and determines the sound acquiring device as the sound acquiringdevice meeting the preset condition.

FIG. 2H is a schematic diagram showing determination of the soundacquiring device which collects the strongest sound signal as the soundacquiring device meeting the preset condition according to an exemplaryembodiment. As shown in FIG. 2H, there are three sound acquiring devicesin surveillance images, i.e., an audio apparatus 19, a Bluetooth headset20, and a mobile phone 21. If a person 11 enters into a surveillancearea corresponding to the surveillance images, a monitoring device 10determines the person 11 as the surveilled object, and then sends acollection instruction to the audio apparatus 19, the Bluetooth headset20, and the mobile phone 21. After receiving the collection instruction,the three sound acquiring devices collect sounds from the person 11 andsend the collected sounds to the monitoring device 10. The monitoringdevice 10 checks the sounds collected by the three sound acquiringdevices, and determines that the Bluetooth headset 20 collects thestrongest sound signal, and thereby determines the Bluetooth headset 20as the sound acquiring device meeting the preset condition.

In a third implementation 102 b 3 (FIG. 2G), at least one mobile deviceassociated with the monitoring device is determined as the soundacquiring device meeting the preset condition.

The monitoring device may be associated with mobile devices which moveinside a house, such as a mobile terminal, a home cleaning robot, or aremotely controlled plane. When the surveilled object is too far fromthe monitoring device, one or more of these mobile devices aredetermined as the sound acquiring devices meeting the preset condition.

A possible implementation is shown in FIG. 2I which is a flowchartshowing a method for identifying a sound acquiring device closest to thesound-making surveilled object in surveillance images among all soundacquiring devices associated with the monitoring device according to anexemplary embodiment. As shown in FIG. 2I, the first implementation 102b 1 in step 102 b may include the one or more of the following twoimplementations.

In a first implementation 102 b 1 a, by performing an indoor positioningprocess, the sound acquiring device closest to the sound-makingsurveilled object is identified among all sound acquiring devicesassociated with the monitoring device.

Monitoring device may be installed in a plurality of rooms, and themonitoring devices may be connected via wireless or wired networks toform an indoor positioning system. Thus, persons, animals, or homeappliances and the like in the interior of the rooms may be surveilled.When a sound-making surveilled object appears in surveillance images ofa monitoring device, a sound acquiring device closest to the surveilledobject can be identified from all the sound acquiring devices associatedwith the monitoring device, and the monitoring device can send acollection instruction to the sound acquiring device to instruct thesound acquiring device to collect the sounds from the surveilled object.

In a second implementation 102 b 1 b, by performing an image recognitionprocess, a location of the sound-making surveilled object is determined,and a sound acquiring device for monitoring the sounds from thesound-making surveilled object is determined according to respectivesurveillance area ranges corresponding to the sound acquiring devices.

Each sound acquiring device has individual surveillance area range. Thesurveillance range data of all sound acquiring devices may be recordedin the monitoring device. According to the surveillance images, themonitoring device can determine a surveillance area range of a soundacquiring device in which the sound-making surveilled object is, andthus the monitoring device can determine the sound acquiring device formonitoring the surveilled object.

FIG. 2J is a schematic diagram showing that the monitoring devicedetermines a sound acquiring device for monitoring the sounds from thesound-making surveilled object according to an exemplary embodiment. Asshown in FIG. 2J, there are two corners in the surveillance areacorresponding to the current surveillance images where monitoringdevices 10 a and 10 b are installed. The monitoring devices 10 a and 10b are connected with each other via wireless or wired networks to forman indoor positioning system. When a TV 15 in the surveillance images ofthe monitoring device 10 a is turned on, according to the surveillanceimages, the monitoring device 10 a determines that there is only onesound acquiring device (i.e., an audio apparatus 19) in the surveillanceimages, but the TV 15 is not in the surveillance area range 19 a of theaudio apparatus 19. Thus, the monitoring device 10 a sends an inquiryinstruction to the monitoring device 10 b to inquire whether there is amobile device associated with all the monitoring devices in thesurveillance images of the monitoring device 10 b. After receiving theinquiry instruction, the monitoring device 10 b determines that a homecleaning robot 23 in corresponding surveillance images is associatedwith all the monitoring devices, and sends a moving instruction to thehome cleaning robot 23 to instruct the home cleaning robot 23 to moveinto a surveillance area corresponding to the surveillance images of themonitoring device 10 a. The monitoring device 10 a sends the homecleaning robot 23 a moving instruction for instructing the home cleaningrobot 23 to move to the location adjacent to the TV 15 to make the TV 15in the surveillance area range 23 a of the home cleaning robot 23.Afterwards, the monitoring device 10 a sends the home cleaning robot 23a collection instruction for instructing the home cleaning robot 23 tocollect the sounds from the TV 15.

Still referring to FIG. 2J, when a dog 13 enters into a surveillancearea corresponding to the surveillance images of the monitoring device10 b, according to the surveillance images, the monitoring device 10 bdetermines that there are two sound acquiring devices (i.e., a mobilephone 21 and the home cleaning robot 23) in the surveillance images, thedog 13 is in the surveillance area range 21 a of the mobile phone 21 butnot in the surveillance area range 23 a of the home cleaning robot 23.At this time, the monitoring device 10 b may send a collectioninstruction to the mobile phone 21 to instruct to the mobile phone 21 tocollect the sounds from the dog 13. Further, in order to achieve atbetter sound collection effects, the monitoring device 10 b may send thehome cleaning robot 23 a moving instruction for instructing the homecleaning robot 23 to move to a location nearby the dog 13 to make thedog 13 in the surveillance area range 23 a of the home cleaning robot23, and a collection instruction for instructing the home cleaning robot23 to collect the sounds from the dog 13.

FIG. 2K is a flowchart showing a method for controlling a soundacquiring device to collect sounds from a surveilled object according toan exemplary embodiment. As shown in FIG. 2K, step 103 (FIG. 1) mayinclude one or more of the following three implementations.

In a first implementation 103 a, when the sound acquiring device meetingthe preset condition is a sound acquiring device closest to thesound-making surveilled object, the sound acquiring device is controlledto collect sounds.

When the monitoring device cannot collect the sounds associated with thesound-making surveilled object in the surveillance images temporarily,the monitoring device can send a collection instruction to a soundacquiring device closest to the sound-making surveilled object toinstruct the sound acquiring device to collect the sounds made by thesurveilled object.

In a second implementation 103 b, when the sound acquiring devicemeeting the preset condition is a sound acquiring device which collectsthe strongest sound signal, the sound acquiring device is controlled tocollect sounds.

When the monitoring device cannot collect the sounds associated with thesound-making surveilled object in the surveillance images temporarily,the monitoring device can send a collection instruction to a soundacquiring device which collects the strongest sound signal to instructthe sound acquiring device to collect the sounds made by the surveilledobject.

In a third implementation 103 c, when the sound acquiring device meetingthe preset condition is a mobile device associated with the monitoringdevice, the mobile device is controlled to move to a location adjacentto the sound-making surveilled object in the surveillance images, andthe mobile device is controlled to collect sounds at the location.

When the monitoring device determines that the sound acquiring devicemeeting the preset condition is a mobile device associated with themonitoring device, the monitoring device may send the mobile device amoving instruction for instructing the mobile device to move to alocation nearby the sound-making surveilled object in the surveillanceimages, and a collection instruction for instructing the mobile deviceto collect the sounds from the sound-making surveilled object.

FIG. 2L is a schematic diagram showing that a monitoring device controlsa mobile device to move to a location adjacent to a sound-makingsurveilled object in surveillance images according to an exemplaryembodiment. As shown in FIG. 2L, when a monitoring device 10 cannotdetect the sounds made by a cat 12, the monitoring device 10 determinesthe sound acquiring devices meeting the preset condition as a remotelycontrolled plane 22 or a home cleaning robot 23 associated with themonitoring device 10. The monitoring device 10 then sends the remotelycontrolled plane 22 or the home cleaning robot 23 a moving instructionand a collection instruction. The moving instruction instructs theremotely controlled plane 22 or the home cleaning robot 23 to move tothe location adjacent to the cat 12, and the collection instructioninstructs the remotely controlled plane 22 or the home cleaning robot 23to collect the sounds made by the cat 12.

The following are embodiments of the device of the present disclosure,which may be used to perform the embodiments of the method of thepresent disclosure. For the undisclosed details in the embodiments ofthe device, refer to the embodiments of the method of the presentdisclosure.

FIG. 3 is a block diagram showing a device for recording an audio signalassociated with surveillance images according to an exemplaryembodiment. As shown in FIG. 3, the device for collecting soundsassociated with surveillance images includes but not limited to adetection module 201, a determination module 202, and a control module203.

The detection module 201 is configured to, when surveillance images arecollected by a camera of a monitoring device, detect and identify asound-making surveilled object in the surveillance images.

The determination module 202 is configured to, if the detection module201 detects that there is a sound-making surveilled object in thesurveillance images, determine a sound acquiring device meeting a presetcondition corresponding to that a signal strength of the sound from theidentified surveilled object detected by the sound acquiring device isgreater than a signal strength of the sound from the identifiedsurveilled object detected by the monitoring device.

The control module 203 is configured to control the sound acquiringdevice determined by the determination module 202 to collect the soundsfrom the surveilled object.

A possible implementation is shown in FIG. 4 which is a block diagramshowing a device for recording an audio signal associated withsurveillance images according to another exemplary embodiment.

As shown in FIG. 4, the detection module 201 includes a first detectionsubmodule 201 a, a second detection submodule 201 b, and a thirddetection submodule 201 c.

The first detection submodule 201 a is configured to detect whetherthere is a movement of the surveilled object that corresponds to apredetermined sound-making movement in the surveillance images. Thepredetermined sound-making movement includes a surveilled objectentering into the surveillance images or a surveilled object whose lipsmove.

The second detection submodule 201 b is configured to detect whether thesurveilled object in the surveillance images is a predeterminedsound-making object. The predetermined sound-making object includes adoor, a window, or a home appliance.

The third detection submodule 201 c is configured to, according to oneor more parameters reported by a detection device, detect whether thereis a sound-making surveilled object in the surveillance images. Thedetection device is a device associated with the monitoring device fordetecting the one or more parameters, and the one or more parametersinclude on/off states, air quality parameters, temperature, parametersindicating changes of heat sources, or physiological feature parametersof the surveilled object.

In a possible implementation, still referring to FIG. 4, thedetermination module 202 includes a fourth detection submodule 202 a anda first determination submodule 202 b.

The fourth detection submodule 202 a is configured to detect whethersounds associated with the surveillance images collected by themonitoring device are smaller than a preset sound threshold.

The first determination submodule 202 b is configured to, if the fourthdetection submodule 202 a detects that the sounds associated with thesurveillance images collected by the monitoring device are smaller thanthe preset sound threshold, determine the sound acquiring device meetingthe preset condition.

In a possible implementation, still referring to FIG. 4, the firstdetermination submodule 202 b includes a first identifying submodule 202b 1, a second identifying submodule 202 b 2, or a second determinationsubmodule 202 b 3.

The first identifying submodule 202 b 1 is configured to identify asound acquiring device closest to the sound-making surveilled objectamong all sound acquiring devices associated with the monitoring device,and determine the identified sound acquiring device as the soundacquiring device meeting the preset condition.

The second identifying submodule 202 b 2 is configured to control allsound acquiring devices associated with the monitoring device to collectthe sounds from the sound-making surveilled object, and determine asound acquiring device which collects a strongest sound signal as thesound acquiring device meeting the preset condition.

The second determination submodule 202 b 3 is configured to determine atleast one mobile device associated with the monitoring device as thesound acquiring device meeting the preset condition.

In a possible implementation, still referring to FIG. 4, the firstidentifying submodule 202 b 1 includes a third identifying submodule 202b 1 a or a fourth determination submodule 202 b 1 b.

The third identifying submodule 202 b 1 a is configured to, by an indoorpositioning technology, identify the sound acquiring device closest tothe sound-making surveilled object among all sound acquiring devicesassociated with the monitoring device.

The fourth determination submodule 202 b 1 b is configured to, by animage recognition technology, determine a location where thesound-making surveilled object is, and determine a sound acquiringdevice for monitoring the sounds from the surveilled object makingsounds according to respective surveillance area ranges corresponding tothe sound acquiring devices.

In a possible implementation, still referring to FIG. 4, the controlmodule 203 includes a first control submodule 203 a, a second controlsubmodule 203 b, or a third control submodule 203 c.

The first control submodule 203 a is configured to, when the soundacquiring device meeting the preset condition is a sound acquiringdevice closest to the sound-making surveilled object, control the soundacquiring device to collect sounds.

The second control submodule 203 b is configured to, when the soundacquiring device meeting the preset condition is a sound acquiringdevice which collects the strongest sound signal, control the soundacquiring device to collect sounds.

The third control submodule 203 c is configured to, when the soundacquiring device meeting the preset condition is a mobile deviceassociated with the monitoring device, control the mobile device to moveto a location adjacent to the sound-making surveilled object in thesurveillance images, and control the mobile device to collect sounds atthe location.

In view of the above, in the device for collecting sounds associatedwith surveillance images provided by embodiments of the presentdisclosure, a sound-making surveilled object in the surveillance imagesis identified, and a sound acquiring device which collects sounds of agreater signal strength from the surveilled object than the signalstrength of the sounds collected by the monitoring device from thesurveilled object is controlled to collect the sounds from thesurveilled object. Thus, the present disclosure can solve the problemthat a monitoring device cannot clearly collect sounds from a surveilledobject which is relatively far from the monitoring device. Themonitoring device controls the sound acquiring device to collect thesounds from the surveilled object, and thus the surveillance informationbecomes more complete.

In addition, when the monitoring device cannot clearly collect thesounds made by the surveilled object, the monitoring device may send acollection instruction to a sound acquiring device meeting a presetcondition to instruct the sound acquiring device to collect the soundsfrom the surveilled object. The preset condition corresponding to thatthe sound acquiring device is closest to the surveilled object, or thatthe sound acquiring device collects the strongest sound signal, or thatthe sound acquiring device is a mobile device associated with themonitoring device.

With respect to the devices in the above embodiments, the specificmanners for performing operations for individual modules therein havebeen described in detail in the embodiments regarding the methods, whichwill not be elaborated herein.

An exemplary embodiment of the present disclosure provides a device forcollecting sounds associated with surveillance images, which is capableof realizing the method for collecting sounds associated withsurveillance images provided by the present disclosure. The device forcollecting sounds associated with surveillance images includes aprocessor and a memory for storing instructions executable by theprocessor. The processor is configured to, when surveillance images arecollected by a camera of a monitoring device, detect whether there is asound-making surveilled object in the surveillance images; if asound-making surveilled object in the surveillance images is identified,determine a sound acquiring device meeting a preset conditioncorresponding to that a signal strength of the sounds collected by thesound acquiring device from the surveilled object is greater than asignal strength of the sounds collected by the monitoring device fromthe surveilled object; and control the sound acquiring device to collectthe sounds from the surveilled object.

It is noted that the various modules, sub-modules, units, or componentsdescribed in the present disclosure can be implemented using anysuitable technology. In an example, a module, submodule, unit, orcomponent can be implemented using circuitry such as an integratedcircuit (IC). In an example, a module, submodule, unit, or component canbe implemented as processing circuitry executing software instructions.

FIG. 5 is a block diagram showing a device for collecting soundsassociated with surveillance images according to an exemplaryembodiment. For example, the device 400 may be a mobile phone, acomputer, a digital broadcast terminal, a messaging device, a gamingconsole, a tablet, a medical device, exercise equipment, a personaldigital assistant, and the like.

Referring to FIG. 5, the device 400 may include one or more of thefollowing components: a processing component 402, a memory 404, a powercomponent 406, a multimedia component 408, an audio component 410, aninput/output (I/O) interface 412, a sensor component 414, and acommunication component 416.

The processing component 402 typically controls overall operations ofthe device 400, such as the operations associated with display,telephone calls, data communications, camera operations, and recordingoperations. The processing component 402 may include one or moreprocessors 418 to execute instructions to perform all or part of thesteps in the above described methods. Moreover, the processing component402 may include one or more modules which facilitate the interactionbetween the processing component 402 and other components. For instance,the processing component 402 may include a multimedia module tofacilitate the interaction between the multimedia component 408 and theprocessing component 402.

The memory 404 is configured to store various types of data to supportthe operation of the device 400. Examples of such data includeinstructions for any applications or methods operated on the device 400,contact data, phonebook data, messages, pictures, video, etc. The memory404 may be implemented using any type of volatile or non-volatile memorydevices, or a combination thereof, such as a static random access memory(SRAM), an electrically erasable programmable read-only memory (EEPROM),an erasable programmable read-only memory (EPROM), a programmableread-only memory (PROM), a read-only memory (ROM), a magnetic memory, aflash memory, a magnetic or optical disk.

The power component 406 provides power to various components of thedevice 400. The power component 406 may include a power managementsystem, one or more power sources, and any other components associatedwith the generation, management, and distribution of power in the device400.

The multimedia component 408 includes a screen providing an outputinterface between the device 400 and the user. In some embodiments, thescreen may include a liquid crystal display (LCD) and a touch panel(TP). If the screen includes the touch panel, the screen may beimplemented as a touch screen to receive input signals from the user.The touch panel includes one or more touch sensors to sense touches,swipes, and gestures on the touch panel. The touch sensors may not onlysense a boundary of a touch or swipe action, but also sense a period oftime and a pressure associated with the touch or swipe action. In someembodiments, the multimedia component 408 includes a front camera and/ora rear camera. The front camera and the rear camera may receive anexternal multimedia datum while the device 400 is in an operation mode,such as a photographing mode or a video mode. Each of the front cameraand the rear camera may be a fixed optical lens system or have focus andoptical zoom capability.

The audio component 410 is configured to output and/or input audiosignals. For example, the audio component 410 includes a microphone(“MIC”) configured to receive an external audio signal when the device400 is in an operation mode, such as a call mode, a recording mode, anda voice recognition mode. The received audio signal may be furtherstored in the memory 404 or transmitted via the communication component416. In some embodiments, the audio component 410 further includes aspeaker to output audio signals.

The I/O interface 412 provides an interface between the processingcomponent 402 and peripheral interface modules, such as a keyboard, aclick wheel, buttons, and the like. The buttons may include, but are notlimited to, a home button, a volume button, a starting button, and alocking button.

The sensor component 414 includes one or more sensors to provide statusassessments of various aspects of the device 400. For instance, thesensor component 414 may detect an open/closed status of the device 400,relative positioning of components, e.g., the display and the keypad, ofthe device 400, a change in position of the device 400 or a component ofthe device 400, a presence or absence of user contact with the device400, an orientation or an acceleration/deceleration of the device 400,and a change in temperature of the device 400. The sensor component 414may include a proximity sensor configured to detect the presence ofnearby objects without any physical contact. The sensor component 414may also include a light sensor, such as a CMOS or CCD image sensor, foruse in imaging applications. In some embodiments, the sensor component414 may also include an accelerometer sensor, a gyroscope sensor, amagnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 416 is configured to facilitatecommunication, wired or wirelessly, between the device 400 and otherdevices. The device 400 can access a wireless network based on acommunication standard, such as WiFi, 2G, or 3G, or a combinationthereof. In one exemplary embodiment, the communication component 416receives a broadcast signal or broadcast associated information from anexternal broadcast management system via a broadcast channel. In oneexemplary embodiment, the communication component 416 further includes anear field communication (NFC) module to facilitate short-rangecommunications. For example, the NFC module may be implemented based ona radio frequency identification (RFID) technology, an infrared dataassociation (IrDA) technology, an ultra-wideband (UWB) technology, aBluetooth (BT) technology, and other technologies.

In exemplary embodiments, the device 400 may be implemented with one ormore application specific integrated circuits (ASICs), digital signalprocessors (DSPs), digital signal processing devices (DSPDs),programmable logic devices (PLDs), field programmable gate arrays(FPGAs), controllers, micro-controllers, microprocessors, or otherelectronic components, for performing the above described methods forcollecting sounds associated with surveillance images.

In exemplary embodiments, there is also provided a non-transitorycomputer-readable storage medium including instructions, such asincluded in the memory 404, executable by the processor 418 in thedevice 400, for performing the above-described methods for collectingsounds associated with surveillance images. For example, thenon-transitory computer-readable storage medium may be a ROM, a RAM, aCD-ROM, a magnetic tape, a floppy disc, an optical data storage device,and the like.

Other embodiments of the present disclosure will be apparent to thoseskilled in the art from consideration of the specification and practiceof the invention disclosed here. This application is intended to coverany variations, uses, or adaptations of the present disclosure followingthe general principles thereof and including such departures from thepresent disclosure as come within known or customary practice in theart. It is intended that the specification and examples be considered asexemplary only, and a scope and spirit of the present disclosure areindicated by the following claims.

It will be appreciated that the present disclosure is not limited to theexact configurations that has been described above and illustrated inthe accompanying drawings, and that various modifications and changescan be made without departing from the scope thereof. It is intendedthat the scope of the present disclosure only be limited by the appendedclaims.

What is claimed is:
 1. A method for collecting sounds associated withsurveillance images, the method comprising: identifying a sound-makingsurveilled object in the surveillance images, the surveillance imagesbeing captured by a camera of a monitoring device; determining whether asound acquiring device meets a preset condition, including determiningthat the sound acquiring device meets the preset condition when a signalstrength of the sounds from the sound-making surveilled object andcollected by the sound acquiring device is greater than a signalstrength of the sounds from the sound-making surveilled object andcollected by the monitoring device, wherein determining whether thesound acquiring device meets the preset condition further includes:identifying a sound acquiring device closest to the sound-makingsurveilled object among all sound acquiring devices associated with themonitoring device, and determining the identified sound acquiring deviceas the sound acquiring device meeting the preset condition; orcontrolling all sound acquiring devices associated with the monitoringdevice to collect the sounds from the sound-making surveilled object,and determining a sound acquiring device that detects a strongest signalstrength of the sounds from the sound-making surveilled object as thesound acquiring device meeting the preset condition; and whendetermining that the sound acquiring device meets the preset condition,controlling the sound acquiring device to collect the sounds from thesound-making surveilled object.
 2. The method according to claim 1,further comprising: when determining that the sound acquiring devicedoes not meet the preset condition, collecting the sounds from thesound-making surveilled object by the monitoring device.
 3. The methodaccording to claim 1, wherein identifying the sound-making surveilledobject in the surveillance images comprises: detecting a movement of thesound-making surveilled object that corresponds to a predeterminedsound-making movement, the predetermined sound-making movement includingthe sound-making surveilled object entering a surveillance area or thesound-making surveilled object having moving lips; or determiningwhether the sound-making surveilled object is a predeterminedsound-making object, the predetermined sound-making object including adoor, a window, or a home appliance; or detecting, by a detection deviceassociated with the sound-making surveilled object, one or moreparameters, and identifying the sound-making surveilled object based onthe one or more parameters from the detection device, the one or moreparameters including an on/off state, a temperature, a change of a heatsource, or a physiological feature of the sound-making surveilledobject.
 4. The method according to claim 1, wherein determining whetherthe sound acquiring device meets the preset condition further comprises:determining that the sound acquiring device meets the preset conditionwhen the signal strength of the sounds from the sound-making surveilledobject and collected by the monitoring device is smaller than a presetsound threshold.
 5. The method according to claim 1, wherein identifyingthe sound acquiring device closest to the sound-making surveilled objectamong all the sound acquiring devices associated with the monitoringdevice comprises: identifying the sound acquiring device closest to thesound-making surveilled object among all the sound acquiring devicesassociated with the monitoring device by performing an indoorpositioning process; or determining a location of the sound-makingsurveilled object by performing an image recognition process, anddetermining a sound acquiring device for monitoring the sounds from thesound-making surveilled object according to respective surveillance arearanges corresponding to the sound acquiring devices.
 6. A device forcollecting sounds associated with surveillance images, comprising: aprocessor; and a memory for storing instructions executable by theprocessor; wherein the processor is configured to: identify asound-making surveilled object in the surveillance images, thesurveillance images being captured by a camera of a monitoring device;determine whether a sound acquiring device meets a preset condition,including determining that the sound acquiring device meets the presetcondition when a signal strength of the sounds from the sound-makingsurveilled object and collected by the sound acquiring device is greaterthan a signal strength of the sounds from the sound-making surveilledobject and collected by the monitoring device, wherein, when determiningwhether the sound acquiring device meets the preset condition, theprocessor is further configured to: identify a sound acquiring deviceclosest to the sound-making surveilled object among all sound acquiringdevices associated with the monitoring device, and determining theidentified sound acquiring device as the sound acquiring device meetingthe preset condition; or control all sound acquiring devices associatedwith the monitoring device to collect the sounds from the sound-makingsurveilled object, and determining a sound acquiring device that detectsa strongest signal strength of the sounds from the sound-makingsurveilled object as the sound acquiring device meeting the presetcondition; and when determining that the sound acquiring device meetsthe preset condition, control the sound acquiring device to collect thesounds from the sound-making surveilled object.
 7. The device accordingto claim 6, wherein the processor is configured to when determining thatthe sound acquiring device does not meet the preset condition, collectthe sounds from the sound-making surveilled object by the monitoringdevice.
 8. The device according to claim 6, wherein, when identifyingthe sound-making surveilled object in the surveillance images, theprocessor is configured to detect a movement of the sound-makingsurveilled object that corresponds to a predetermined sound-makingmovement, the predetermined sound-making movement including thesound-making surveilled object entering a surveillance area or thesound-making surveilled object having moving lips; or determine whetherthe sound-making surveilled object is a predetermined sound-makingobject, the predetermined sound-making object including a door, awindow, or a home appliance; or detect, by a detection device associatedwith the sound-making surveilled object, one or more parameters, andidentify the sound-making surveilled object based on the one or moreparameters from the detection device, the one or more parametersincluding an on/off state, a temperature, a change of a heat source, ora physiological feature of the sound-making surveilled object.
 9. Thedevice according to claim 6, wherein the processor is configured todetermine that the sound acquiring device meets the preset conditionwhen the signal strength of the sounds from the sound-making surveilledobject and collected by the monitoring device is smaller than a presetsound threshold.
 10. The device according to claim 6, wherein, whenidentifying the sound acquiring device closest to the sound-makingsurveilled object among all the sound acquiring devices associated withthe monitoring device, the processor is configured to identify the soundacquiring device closest to the sound-making surveilled object among allthe sound acquiring devices associated with the monitoring device byperforming an indoor positioning process; or determine a location of thesound-making surveilled object by performing an image recognitionprocess, and determining a sound acquiring device for monitoring thesounds from the sound-making surveilled object according to respectivesurveillance area ranges corresponding to the sound acquiring devices.11. A non-transitory computer-readable storage medium having storedtherein instructions that, when executed by a processor of a monitoringdevice, causes the monitoring device to perform a method for collectingsounds associated with surveillance images, the method comprising:identifying a sound-making surveilled object in the surveillance images,the surveillance images being captured by a camera of a monitoringdevice; determining whether a sound acquiring device meets a presetcondition, including determining that the sound acquiring device meetsthe preset condition when a signal strength of the sounds from thesound-making surveilled object and collected by the sound acquiringdevice is greater than a signal strength of the sounds from thesound-making surveilled object and collected by the monitoring device,wherein determining whether the sound acquiring device meets the presetcondition further includes: identifying a sound acquiring device closestto the sound-making surveilled object among all sound acquiring devicesassociated with the monitoring device, and determining the identifiedsound acquiring device as the sound acquiring device meeting the presetcondition; or controlling all sound acquiring devices associated withthe monitoring device to collect the sounds from the sound-makingsurveilled object, and determining a sound acquiring device that detectsa strongest signal strength of the sounds from the sound-makingsurveilled object as the sound acquiring device meeting the presetcondition; and when determining that the sound acquiring device meetsthe preset condition, controlling the sound acquiring device to collectthe sounds from the sound-making surveilled object.
 12. Thenon-transitory computer-readable storage medium according to claim 11,wherein the method further comprising: when determining that the soundacquiring device does not meet the preset condition, collecting thesounds from the sound-making surveilled object by the monitoring device.13. The non-transitory computer-readable storage medium according toclaim 11, wherein identifying the sound-making surveilled objectcomprises: detecting a movement of the sound-making surveilled objectthat corresponds to a predetermined sound-making movement, thepredetermined sound-making movement including the sound-makingsurveilled object entering a surveillance area or the sound-makingsurveilled object having moving lips; or determining whether thesound-making surveilled object is a predetermined sound-making object,the predetermined sound-making object including a door, a window, or ahome appliance; or detecting, by a detection device associated with thesound-making surveilled object, one or more parameters, and identifyingthe sound-making surveilled object based on the one or more parametersfrom the detection device, the one or more parameters including anon/off state, a temperature, a change of a heat source, or aphysiological feature of the sound-making surveilled object.
 14. Thenon-transitory computer-readable storage medium according to claim 11,wherein determining whether the sound acquiring device meets the presetcondition further comprises: determining that the sound acquiring devicemeets the preset condition when the signal strength of the sounds fromthe sound-making surveilled object and collected by the monitoringdevice is smaller than a preset sound threshold.
 15. The non-transitorycomputer-readable storage medium according to claim 11, whereinidentifying the sound acquiring device closest to the sound-makingsurveilled object among all the sound acquiring devices associated withthe monitoring device comprises: identifying the sound acquiring deviceclosest to the sound-making surveilled object among all the soundacquiring devices associated with the monitoring device by performing anindoor positioning process; or determining a location of thesound-making surveilled object by performing an image recognitionprocess, and determining a sound acquiring device for monitoring thesound from the sound-making surveilled object according to respectivesurveillance area ranges corresponding to the sound acquiring devices.